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AiBSTRACT 

Despite iifcreased interest in and acceptance of the 
concept and mandate of providing adaptive instiruction to ensure 
schooling success for each student, a sizable gap es&ists between 
identification^ of specific educational practices and application of 
such practices in schools. The work described in this paper ,is aimed , 
at examining th^- feasibility and practicability of widespread 
implementation of an adaptive instruction approach. Discussion 
focuses on four areas: (1) the conceptual and practical implications 
of the adaptive instruction approach and the effective allocation and 
use of'school time; (2) the rationale and design of an adaptive ^ 
instruction, program that includes features thought to be .part i cularly 
effective in enhancing student learning; (3) the results of a 
descriptive study of the program's impact on classroom processes, 
student achievement, and the allocation and use o£ School time; and 
(41 the comparability of the study's findings with recent literature 
oh effective classroom instruction in general and investigations of 
the use of school Trme and student learning in particular. The 
descriptive study was conducted in 156 kindergarten through 
third-grade classrooms where the Adaptive Learning Environments Model 
was implemented as the core educational program. It is concluded that 
it is unnecessary to-trade off achievement in basic skills for 
student growth in areas such as independence, self-responsibili.ty f 
and social cooperation. (Author/RH) 
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' Abstract 

The work described in this papet is aimed at examining the 
feasibility and practicability of widespread implementation of an 
adaptive instruction approach . Discussion focuses on four major 
areas: the concept and practice of adaptive instruction; the rationale 
and design of an adaptive instruction program; y results of a study 
conducted in 156 » classrooms in school sites with 'widely varying 
characteristics, in terms of the program's overall im.pacts on classroom 
.processes, allocation and use of school time, and student achievement; 

and comparability of the findings with the extant literature on 

* * *. * 

'< 

effective classroom instruction. 
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Provision of Adaptive Instruction: 
Implementation and Effects 

^ Margaret C. Wang 

teaming Research and Development Center 
University of Pittsburgh 

f 

Throughout the history of formal schooling, use ^of alternative 
instructional strategies and school resources to provide learning 
experiences that are adaptive to student differences has been the object 
of educators' continuing interest. PartlAtularly during the past 15 
/ears, the implementation and effects of adaptive instruction programs 
have become associated with school improvement efforts and federal 
legislation aimed at- ensuring effective schooling for all children and 
young adults. * . yj ' • 

Improving schools' capabilities to provide equal and quality 
educational opportunities for an increasingly diverse student populatibn 
has been singled out as one of the most critical tasks facing educators 
and researchers today. Public sentiment, economic realities, and recent 
federal and state legislation have created mandates for change in, areas 
such as school desegregation and the provision of equal and appropriate 
educational experiences for children of all races, .J^g^uage groups, 
social classes, and unique educational characteristics. Schools at 
every level are asked to integrate children with a wide range of 
educational, physical, and emotional conditions into regular classrooms. 
As a result , teachers are faced with the task of finding alternate ways 
and additional time to meet disparate student needs within the 
constraints- of schools' present organizational systems and resources. 
Thus, research on ways to accommodate diverse student needs through 



maximal use of resources such as school time has been given high 
priarity. 

Despite this increased interest and widespread ' acceptance of the 
concept and mandate of providing adaptive instruction that ensures 
schooling success for each student , there continues to be a sizable gap 
between the Identification of specific educational practices and the 
operationalization of such practices in actual schee4r^set tings • It was 
in this context that the work described in this paper was initiated* 
The specific goal of this work has been to increase understanding bf the 
basics of adaptive itistruction as well- as its implications for 
effective4:y reducing the amount of time needed by each student for 
learning while increasing the allocation^^^ effective use of school 
time for instruction and learning. The paper includes discussions in 
four areas: the conceptiial and practical implications of the adaptive 
instruction approach and the effective ' allocation an(| use of school 
time; the rationale and design of an adaptive instruction program that 
includes features thought to be particularly effective in enhancing^ 
student learning by decreasing the amount of time neecfed to learn and 
increasing the amount of time students actively spend on learning; the 
results of a descriptive study of the program's impact on classroom 
processes 9 student achievement, and the allocation and us^ of school 
time; and the comparability of the study's findings with recent 
literature on effective classroom instruction in general and 
investigations of the use of school time and student learning in 
particular* 



The Concept and Practice of Adaptive Instruction 

Adaptive Instruction Is defined here as the use of alternative 
Instructional strategies and school resources to provide learning, 
experiences that are effective In meeting the learning needs of 
Individual students. The ad'aptlve Instrudtlon approach has ^become 
widely recognized as viable for ensuring quality education for all 
students (e.g., Conslllo, 1974; Gordon, 1979; Reynolds & Birch, 1977). 
This recognition has resulted. In part, fro© technical advances during 
the past decade In the development of relevant theories and 
Instructional practices (e.g., Glaser, 1977; Henry, 1962; Snow, 1977; 
Welsberger, 1977) and growing "consumer" Interest in educational 
programs and Instructional technology that adapt schooling ' to the 
different experiences. Interests, abilities, and socioeconomic 
backgrounds of individual students (Eleynolds & Wang, 1981; Wang, 1980; 
Wendel, 1977). 

The underlying assumption of the adaptive . instiyction approach is 
that students ^ learn in different ways and at different rates. These 
differences require the provision of a variety of, instructional 
techniques and learning experiences that match the needs oif each student 
as well as the allocation of adequate amounts of time for all students 
to learn. As pointed out by Glaser (1977), the match between learning 
experiences and student needs in effective adaptive instruction programs 
is based on knowledge about each student's learning characteristics, his 
or her past performance and present level of competence, and the nature 
and type of learning tasks to be performed. Essentially, the objective 
is to bring students' abilities into a range of competence that enhances 
their capabilities to profit from available learning alternatives . 



Thus, it is expected that by improving schools' adaptability and 
students' capabilities, every student will be provided with increased 
opportunities to experience success in school learning (Glaser , 1977) . 

As witlVj all innovative concepts , there has been some difference of 
opinion regarding the operational definition of adaptive instruction. 
It is Important to note several distinctions • First, contrary to 
frequent portrayals in the recent effective teactfing literature , 
adaptive ' instruction (sometimes referred to by researchers and 
practitioners as individualized instruction) is ^ot an educational 
approach that is the direct opposite of the group-based , direct 
instruction approach (e.g., Brophy, 1979; Rosenshine, 1976). Nor is it 
synonymous with the open education approach ,(e .g . , Peterson, 1979). It 
is, instead, an educational approach aimed at providing learning 
experiences that effectively meet the needs of each student. As such, 
its op^rationaliaation incorporates a wide range of alternative 
techniques and practices that could indeed include those associated with 
.direct instruction and/or open education. , 

The second important distii;ict;|.on is that the adoption of 
alternative instructional approaches (e .g ., teacher-directed lessons in 
groups or with individual students , student-initiated exploratory 
activities, and individual and/or group projects) is a '*must" in the 
design of adaptive instruction. A basic requirement for learning 
environments aimed at effectively providing educational experiences that 
are adaptive to student differences is the incorporation of a variety of 
alternative educational objectives and learning experiences, ^n turn, 
different educational Objectives and differences in the nature of the 
tasks to be learned require a variety of alternative teaching and 

4 
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learning techniques • (For example, objectives related to oral 

ccMnmunication and social cooperation require instruction in Interactive 

group settings, while practicing computation skills might be done more 

effectively if designed^as independent seat work.) 

% 

The final distinguishing feature of the aldaptive instruction 
approach is that, although individualized planning is included, each 
student's educational plan need not be, and in many cases should not be, 
carried out entirely on an individual basLs. The inclusion of group 
lessons in individual students' learning, plans is assumed, from, the 
perspectives of effective instructional managament and the pedagc^gical 
requirements for meeting a certain set of objectives. 

Two major design considerations are integral to the 
conceptualization and operationalization of adaptive instruction 
discussed in this' paper. They are (a) accommodation o^f individual 
differences and effective schooling, and (b) effective allocation and 
use of school time and provision of adaptive instruction. 

Individual Differences and Effective S^oolirig 

The basic notion that students , differ as individuals, particularly 
in terms . of their levels of school achievement and their mariners and 
rates of learning, has long been widely accepted. However, a gradual 
change has occurred in the interpretation of information on learning 
differences. Individual differences no longer are viewed as **static." 
Aa pointed out by Bloom (1981), they can be altered either before the 
instructional'-learning process begins or as part of the process. This 
change in the view of individual differences has had profound 
implications for instruction and learning during the past decade. 



Students^ success or failure In school learn^*ng has come to be 
recognized as the responsibility of the school-s rather than simply the 
result of differences In learning characteristics af^d students' basic 
\ capabilities to learn* 

In contrasting the predominant traditional approach of the 
^^^^^lectlVe education mode with that of the adaptive education mode, 
Glaser (1977) has suggested that individual differences in students 
traditionally were accepted as "givens/' serving as a basis' for 
classifying groups of students and differentially predicti;ig> their 
probable future achievement. The selective mode has come to be 
displaced, however, by the view of individual differences as the basis 
for effective instructional planning. Thus, the operational goal of the 
adaptive instruction approach is to adjust to students' current level of 
functioning and/or alter their functioning by using special 
instructional and learning processes to teach prerequisite skills* 

' y ' Changes in the conceptualization of individual differences dictate 

an approach to schooling that Inyolves the identif Idatlon of effective 

processes for providing equal and quality educational opportunities for 

every student* In this context, equal and q^uallty educational 

opportunities refer to the provision of conditions that are equally 

effective in ensuring each student's success in ^earning* Instructional 

planning that Incorporates a wide'^ range of educational opportunities and 

resources, such as school time and personnel deployment, is seen as the 

primary .Cask in improving schools' capabilities to provide effective 

^choo^lng for each student* 
» 
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School Time And Adaptive Instruction , 

Many problems have been encountered in efforts to establish 
educational Nprograms ^whereby all. students receive instruction that 
effectively meets their individual learning needs. Among the^ problems 
cited oDtost frequently are t^e sometimes intractable demands on teachers' 
time and ^the lAck of instructional supports, that; would enable teachers 
to spend more time on instruction-related than oianagement-related tasks 
(Bennett, 1976;^ Rosenshlne, 1979; Wang, 1979a; ftcPartland & Epstein, 
^ote 1). ' ' 

. The amount of school time available tp tieachers and students is 
constrained by both the lengths of the school day and year and each 
student's required amount of teacher instruction and learning time. 
Since the total amount of school time is relatively fixed under the 
present system, an alternative for incr6£^sing the amount of time 
available for instruction and learning is the development of ways to 
make effective use of school time. In the context of adaptive 
instruction, "effective use of school time" cah be c^^efined as a 
reduction of the time needed by each student to learn and an increase in 
the time spent by each student on learning. Thus, school learning is 
seen as Involving both "time needed" and "time spent" in a very dynamic 
way. 

Programs aimed at adapting school learning experiences to student 
differences attribute considerable importance to the interactive effects 
of time and student achievement. In conventional programs, students are 
required to learn particular lessons in a specified interval of time, 
and all students are expected to proceed with their learning at 
essentially the same pace. Each student's progress is Judged in terms 
of the amount or degree of learning he or she achieves within a constant 
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amount of time. The adapcive instruction approach, on the other, hand, 
permits students to progress thtough a given set of learning tasks at 
individual rates. In programs based on this approach, the leve4 or 
degree of mastery is held constant, rather than the amount^ of learning 
time. Each student's performance or progress is assessed in terms of 
the rate at which program objectives are mastered (Wang, 1979b|). Thus, 
the ' task of improving schools' capabilities to provide adaptive 
instruction is twofold. It involves identifying ways to provide the 
amount of time needed by each student for learning and desigi;i^ng 
learning experiences that are likely, to reduce the amount of time edch 
Student needs for learning. It should be pointed out that these two 
major considerations formed the basis for the design and imf^lementation 
of «^he.«,,, Adaptive Learning Environments Model, the ypubject of 
Investigation in the work described in this paper. i 



The Adaptive Learning Environments Model 

The Adaptive Learning Environments Model (ALEM) is an instructional 
program which has been designed^ and studied at the Learning R^earch ^nd 
Development Center of the University of Pittsburgh over the past 10 
years. The overall goal of the ALEM is to create school environments In 
which each student can succeed in acquiring basic academic skills while 
becoming confident in his or her ability to learn and to cope with the 
social and physic^t classroom surroundings (Wang", 1980). One of the 
program's design objectives is to make optimal use of school resources, 
including student and teacher time, in order to provide the programialng 
and classroom organisational supports required to effectively maximize 
eacli student ' s learning* , EsUentially, the ALEM^ s design combines . 



aspectli of prescriptive instruction that have been shown to be effective 

V 



V 



In ensuring basic skills mastery and asppects of Informal education that' 
^are. considered to be condueiv^— to generating at titudes and 'processes of 
Inqulr^, Independence, and social cooperation. 

The .ALEM includes five major program components, > They are (a) a 
basic skills component made up of a variety of highly structured and 
hieirarchically organized prescriptive curricula, as well as a wide range 

of ^inore open-ended exploratory learning activities designed to increase 

,1 

schools' capabilities to adapt to individual students' learning needs 
and interests; (b) ah instructional-learning management system desig^d 
to increase teacher ins^iructional time and foster . student 
self-respbnstlbility; (c) a family inyolvement component aim.ed at 
^ optimizing/ student learning through increased communication and 
integratiori of school and hom.e learning experiences; (d) a multi-age 
grouping and lifistrucMonal- teaming classroom organizational support 
system designed to increase the flexibly usQ^of teacher and student 
talents, time, and other school resources; and (e) a systematic 
approach to staff development that enhances the capability of school 
staff to effectively implement the ALEM in school settings. 



A basic principle underlying the development 9f the ALEM's 
omponents is the importance' of increasing the . capaj3ility of the 



learning environment to adapt to the learning needs of indlv^diial 
students while, at the same time, maximizing each student's capability 
to benefit from the environment. (More detailed descriptions of the 
program and its components ^n be found la a number .of documents, 
includiyg^ Wang, 1980 and Wang and Catalano, Note 2). 



\. .. • 

Although each of the ALEM's major components listed above can be 
traced as haying either 'a direct or indirect relationship to the 
allocation and use of school time, four program design features have 
been included in the desigrt of the ALEM, specifically to enhance the use 
o'f time, by teachers and students. The^ are .(a)\an integrated 
diagnostic-prescriptive process; (b) inclusion of. a wide range of 
learning options; (c) an instructional-learning management support 
system; and (d) an orgahizational , support system • that includes 
multi-age grouping and instructional teaming. These features are 
discussed below in connection with three of the ALEM's program design 
objectives which are related directly to the allocatiotv and use of 
school time. These objectives are to reduce the amount of student time 
needed for learning/ to increase the amount of student tim^ available 
for learnings and to increase the amount of allocated tim^ students and 
teachers aictually spend on instruction and learning. The hypothesized 
relationships between the ^program's time-related^jEeatures and design 
objectives are' indicated in*'Table 1. 

Integrated Diagnostic-Prescriptive ^xoc^ssJ ^ 

An integrated diagnostic-prescriptive process has become an 
operating feature of educational programs aimed at adapting instruction 
to student differences. Such processes pi^ovide for the assessment oj^ 
each student's entering learning behaviors, the development of 
individualized instructional programming, and the continuous monitoring 

and assessment oi students' learning progress. They are seen as program 

* 

design supports that are particularly effective in reducing the amount 
of t;ime needed by individual students to learn and increasing the amount 
of allocated learning time students actually spend on learning. 

10 



Table 1 

Design Features of the Adaptive Learning Environments Model and Their 
Relationship to the Program's Time-Refatcd Objectives 



Time-Related Objectives 



Design Features 



Reduce 
Time Needed 
for Learning 



Increase 
Tim^ Available 
for Instruction 
and Learning 



Increase 
Time Spent 
on Instruction 
and Learning 



Integrated diagnostic* 
prescriptive process 



Wide range of " 
learning options 

Instructiohal-feaming 
management support system 



ClassroofH organizational 
support system (multi-age. 
grouping and instructional teaming) 



ERIC 



11 



A major (iesign task in the development of programs that incorporate 
♦ 

a diagnostic-prescriptive process is the development and sequencing of 
psychologically and ' pedagogically meaningful learning hierarchies 
(Resnick, 1973; Wang & Resnick, 1978; Wang, Resnick, & Boozer, 1971). 
In the ALEM, such learnijng hierarchies form the basis for a 
criterion-referenced testing system that provides teachers, with 
information on the presence clr;absence of specific competencies, thereby 
ensuring • each student's placement' at an lappropriate point in the . 
l^arnii^g sequencer :^n addition, learning hierarchies provide teachers 
with the programming support for st^ructurlng learning experiences so 
that mastery of initial' curricular objectives provides. the prerequisite 
learning skills for mastering later objectives,. In this way, students 
neither repeat tasks they already have mastered nor work . on objectives 
for which they lack critical prerequisite skills . The fine-grained 
steps in its learning hierarchies form the natural checkpoints in the 
ALEM's curricular continuum, permitting' those students who .acquite- 
certain skills before entering the program, or who acquire them quickly, 
to move ahead to more complex tasks. Thus, it becomes possible to 
reduce the amount of time needed by each student for learning. 

The diagnostic-prescriptive process descrl*be4 above essentially is 
an intervention strategy designed Co ensure predominantly successful 
experiences in learning, even foi^ those students who itiitially are the 
least able. The contentions are that success in school learning is 
likely tro lead to the development of students' sense of competence, and 
that ' this sense of competence jresults in« the development of 
self-confidence and a sense, of aelf-^ef f icacy . Furthermore, students' 
perceptions of self-efficacy 'are, related closely to their sense of 
personal control which^ in turn, is assumed to be related closely to the 



amount of time students actually spend on learning or their motivation 
to learn (Wang, 1982). 

/. 

Many have reported evidence of the close relationship between 
skills acquisition and an Increased sense of personal control over the 
"school learning environment (e.j., Bandura, 1977; Bloom, 1976, 1980; 
Covington Beery, 1976; * Covington & Omellch, 1979). . According to 
Bandura. (l98I) , for example, a student's perception of self-ef f Icacy Is 
reflected ' In his or her ability to assess all elements of a situation 
and brganlze and carry out the necessary actions to deal with that, 
situation. §een In this context, self-ef f Icacy can be said to Influence 
a student's choice of activities as well as the amount of effort, vigor, 
*and persistence wltl| *whlch he or she carries out learning tasks. 
Therefore, It Is hypothesized that If school learning environments place 
continuous emphasis on providing opportunities ^or skills acquisition, 
students will gain an Increased sense of competence which will lead' to 
the development of a sense of selt-eff Icacy and personal control^ As 
the result of students' sense of personal control over their learning. 
It Is expected that they will be more likely to view momentary conflicts 
and falliir^s as challenges or signals to modify their behavior, and that 
chey will persist' In spending Che time needed co learn. 

Wide Range of Instrudtlonal-Learnlng Options 

The inclusion of a wide range of learning options in the AL£M' s 
curricula is another design feature intended to enhance the program's 
capability to minimize the amount of time needed by students to 4>^arn 
and Increase the amount of time spei^t on learning. The ALEM' s 
'prescriptive and exploratory curricula . Include a variety ,of 

13 . - ■ 



paper-and-pencil and manipulative materials for use. by students in their 
independent work, and by teachers in individual or group instruction. It 
is anticipated, that a wide range of learning options caa; provide a 
greater number "of opportunities ;to learn in ways that best suit each 
student's unique learning characteristics as well as the nature and 
types of skills to be maat^ed. As a result, the amount of time needed 
by students to acquire mastery of the skills Is likely ,to be reduced. 

The provision of a wide range of learning options also is viewed as 
a factor that contributes to increases in the amouilt of time students 
are willing, to spend on learning. It is anticipated that if students 
are provided with frequent opportunities to successfully acquire basic 
academic skills through a variety of alternative individualized learning 
experiences, they will develop greater motivation to persist in spending 
the time needed to learn. 

Instructional-Learning Management System 

One of the primary objectives of the ALEM's instructional-learning 
management system, known as the SeLf-Schedule System, is to support 
^ teachers and atudents in making maximal use of their instructional and 
r,. learning time and other school resources. The Self-Schedule System iis a 
. progr-anmlng device that allows for the most flexible allocation and use 
of school time by providing teachers with the support to f^ee up more of 
their routine classroom management time for instruction and providing 
.students with increased opportunities to plan and carry out their own 
tasks. 
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Scheduling learning activities and instructional time has been a 
major implementation problem for programs aimed at adapting instruction 
to individual differences. Typically, scheduling choices have been 
limited to group instruction versus individual instruction, free-choice 
versus teacher-prescribed activities, or teacher instruction versus 
independent student work. E£|ective implementation of adaptive 
instruction programs , however , requires the inclusion of all these 
alternatives ^within the context of a flexible school day (Wang, 1974a). 
It is assumed that', under the Self-Schedule System, students are likely 
to choose to work on a variety of tasks, resulting in a flexible 
distribution of teacher time to accommodate the di^f erent instructional 
demands associated with the abilities of individ'ual students. 

Results from a number of studies (e.g.. Brown, 1978; Phares, 1968) 
suggest the close relationship between academic performance and 
self-management . Pines and Julian (1972) found, for example, that 
students who were high in self-management appeared to make much more use 
of previously learned concepts and^principles in problem solving; than 
those who were low in this trait. When such prerequisite skills had not 
been acquired, students with self-management skills were found to 
display- greater persistence in actively seeking the necessary 
information for solving problems. Students who .were low in 
self-management skills, on the other hand, tended to adopt and stick 
wtth a given problem-solving strategy, regardless of its 
appropriateness. The performance of these students improved only when 
they knew they would be provided with evaluative feedback by the 
teacher. These results suggest that one effective way of helping 
student^ succeed in school learning is to create an environment which 
facilitates their ability to manage their own learning behavior. 

15 



Effective ifliplementation of the Self-Schedule System can be 
expected to increase students' motivation and reduce the amount of 
system- imposed distraction in the learning environment. As noted 
earlier y the development of students' basic academic and self -management 
skills is viewed as a way of increasing their sense of self-efficacy or 
personal control over their learningyf thereby increasing their 
willingness to spend the amount of time needed to learn. Under the 
Self-Schedule System, students' willingness to spend the time required 
to learn is further increased by the kind of classroom management that 
results in minimal interference or distraction. Thus, students are 
provided with a chaAce to actually 9pend the time they are willing to 
spend on learning. 

Teaching students to become effective classroom managers also has 
been found to enable teachers to devote more of their time to 
instructional matters (Smith, 1976^ Stone St Vaughn, 1976) than to 
managing students (Kounin, 1970; Bvettson £i Anderson, Note 3). Results 
from a recent study of the effects of the Self-Schedule System in a 
mains treamirfg program for low and high achievers (Weisstein 6f»»iV/i^ng, Note 
4) showed that, in general, teachers' interactions with all students 
were more instruction-related than management-related. Furthermore, the 
low-achieving students initiated more contacts with teachers for 
instructional than management purposes^. In addition, no significant 
differences were observed in the on-task behavior of high achievers and 
low achievers. Each group completed the same number of tasks* Results 
such as these seem to support the advisability of teaching 
self -management skills as a way of/ maximizing both the amount of time 
(Sttidents spend on learning and the amount of time teachers spend 
providing instruction. Thi* Self-Schedule System is postulated on the 
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assumption that Increases In teacher tltn6-^or Instructional purposes are 
likely to Increase the quality df Instruction and^ thereby, reduce the 
amount of time students need for learning (Wang, ld79a)« 

Classroom Organizational Support System 

One of the most frequently cited causes of the unsuccessful 

Implementation of Innovative ptactlces In schools is the lack of 

well-defined organlza^onal supports (Anderson, M973f Conner, . 1^76; 

Decker h Decker, 1977). In particular, th^ adaptive Instruction 

approach challenges teachers to Identify available resources (e.g., 

school 'time and teachers' and students' talents) and manage them ^In wgys 

that create a variety of learning alternatives for meeting students' 

Individual learning needs. Instructional teaming and multi-age grouping 

are programming features Included in the design of the ALEM to Increase 

both the amount of school time available for learning and the amount of 

time students actually spend on learning. 

• . > ' ' • ' '' 

Instructional teaming plays an Important role in increasing 

teachers' flexibility to allocate and use their school time. Students 

in classrooms where instructional teaming is Implemented have been found 

to spend moi;e of their school time receiving instruction than do 

students in self -contained classrooms (e.g., Schmuck, Paddock, & 

Packard, 1977; Cohen, Note 5). By working together in a team for 

instructional purposes and sharing their talents and school resources 

(e.g., instructional materials and time), teachers can provide a wider 

variety of instructional alternatives (Adams, 1962; Arlkado, 1975; 

Wang, 1976) and teaching styles (Dawson & Linstrom, 1974). For example. 

Instead of one teacher being able to provide reading Instruction to only 
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four groups of students at different reading levels , two teachers In 
instructional-teaming situations can jointly service twice as many 
different reading groups. In such ways, the amount of time students 
need for learning is likely to be reduced and the amount of time 
actually spent on learning increased. Many studies have found 
significant ' differences in student achievement, as well as in' students^ 
self-concepts and attitudes toward school (e.g., Klausmeier & QUilXing, 
1967; Pribble & Stephens, Note 6),, in classrooms where some form of 
instructional teaming was implemented. 

In addition to instruCtiogal teaming , the ALEM' s design 
• incorporates a multi-age (ungraded) classroom organizational pattern as 
a way of facilitating the effective allocation and use df school time. 
Essentially, illiulti-age grouping provides the necessary flexibility to 
" accoonnodate the differences of individual students, particularly -those 
who tend to make unusually slow or fast progress. From the teacher's 
perspective, multi-age grouping under the ALEM facilitates the more 
selective and, therefore more effective, use of instructional time, 
according to the varying instructional needs of individuals, and/or 
groups of students. A leas obvious benefit of multi-age grouping is the 
opportunity it provides for both spontaneous and planned peer modeling 
and peer tutoring as ^he result of the integration of students. who are 
at different developmental and academic 'achievement levels (Allen, 1976; 
Wang & Weisatein, 1980). Aaide from the socialization functions that 
have been attributed to peer groups in the literature (e.g., Allen, 
1976; Demos & Demos, 1969; Erikson, 1963; Lippitt, 1976), cross-age 
peer tutoring situations provide additional instructional resources and 
time. ^ese, in turn, have been found to contribute to the school 
achievement and motivation of both those being tutored and the tutors 
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themselves (Fogarty & Wang, 1982; Lohman, 1970; Pelf er , 1972) . The 
common occurrence of peer tutoring In multi-age grouped classrooms also 
enables teachers to spend a greater amount of instructional time witj 
those students who require more teacher assistance. Although, ^ome 
spontaneous peer tutoring and modeling might occur in graded classrooms, 
the greater age span in multi-age grouped classrooms generally Vends to 
result in a wider range of student talents, skills, and interears. When 
viewed as instructional resources, these student characteristic^ are a 
source of additional time for instruction and learning. 

Documentation and Analysis of the 
■ Implementation , and Effects ofgthe ALEM ^ 



'7 

itterns of che 



e ALEM's implementation 
I a descriptive study was 



To investigate the nature and pa 
in school settings and the program's effects 
carried out during the 1980^81 school year. The study had two major 
goals. The first was to investigate the extent to which critical 
dimensions (operating features) of the program were in place in selected 
classrooms and the extent to which a high degree of implementation of 
the ALEM was attained in a variety pf school sites. The dual focus was 
on documenting the characteristics of the classroom environments 
(context variables) under which students and teachers functioned and 
testing the generalizability of the program. The study's second major 
goal was to document the patterns of classroom processes and student 
learning outcomes, as well as the allocation and use of school time, in 
classrooms where the ALEM's critical dimensions were in place. 
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Setting 

The study wa6 conducted during the 1980-81 school year/ in 156 
_jcij(dergarten through third-grade classrooms (including a tolal of 138 
teachers) where the ALEM was implemented as thie^s^ore educational 
progrataf * ' The classrooms were spread across 10 school districts located 
' in communities with varying ethrio-cultural , - socioeconomic, and' 
geographic ' characteristics (e.g«, inner-city, Suburban, rural, and 
Appalachian communities), ,Each cil the school district sites in the 
study implements the ALEM^^^lther as a basic education program in 
conjunction with participation in the National Follow Through Program, a 
compensatory education program sponsored, by the U. ^« Department of 
Education; or as a malnstr^amlng program for mildly handicapped and 
gifted students in conjunction with participation in a project sponsoi^^d 
by the Handicapped Children" 9 Model Program of the Department of 
Education's Special Education Program. Table 2 provides a summary 
description of the participating school sites. 

Measures and Procedures 

Three types of measures were used to obtain data for the study: 
degree of implementation measures, classroom process measures, and 
student learning outcome measures. ^ 

Degree of implementation . The degree of implementation measures 
utilized in the study serve two functions: They assess the presence, and 
absence of critical program features in classrooms where the ALEM is 
implemented, and they provide a description of the context in which 
teachers and students in ALEM classrooms function. The measures were 
based on a series of 96 performance indicators for assessing the 
presence and/or absence of the program's 12 critical dimetisions of the 
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Table 2 

Characteristics of Participating School Sites 
1980-81 School Year 



Characteristics 



Sua 



Title I- i 
Elioible Numbcrof 
Students Participatir>g 
Community |^ District ^^P^^^^^^ Schools 



Follow Through Sues 
School District A 



School District B 
School District C 
School Oislrici D 
School District E 
School Distridt F 



Mainstreaming Sites 
School Oistrict (j 



School District H 
School District I 



Urban Industrial 
Community 



40% 250,000 



Rural Native 52% 
American Community 

/SSimi-rural 20% 
Community 

Rural 22% 

Community 

Rural Appalachian 28% 

ComriHjnity'w^ 

Urban/Rural 24% 
Community 



Suburban Working 1 1% 
Class Communuy 

Large Suburban Low 13% 
SES Community 



Large Suburban 
Mixed Low to Middle 
SES Community 



5% 



School District J SmallTown Suburban 19% 
Low SES Community 



8731 
37.791 

7.000 
28.762 
80.000 

11.901 

♦ 

33.185 
33,172 

10.250 



2 
1 
3 
3 
3 
3 



Numbtr of ALEM Claim ai Each Grada Laval 



1 1-2 



2-3 123 




5 

r 

6 
4 

6 
3 
6 



2 
1 



4 

2 
2 



Total for 10 Siiai 



10 



46 28 11 
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5 
5 
4 

6 



3-4 



3 29 6- 
(166 total CiMtai)* 



Noia. 'BecauM kindargarien clattai in toma diitricii wara only for half a day (AM/PM taitioni). tha total numtitr of diffarant taachari 
for ih« clattM includtd In iha iiudy wat 138. 
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ALEM. The perfomance indicators were derfved from an analysis of the 
program's structural and action domains. The structural domain consists 
of t^ie resources (e.g., materials, space, facilities, time,* and 
personnel) required to create the conditions under which program 
activities can be implemented ef f ectively^. The action domain "consists 
of the role behaviors of instructional staff and , students (Wang, Note 

7). , . • ' ■ • . 

Based on the , performance indicators, the Implementation Assessment 
Battery for. Adaptive Instruction has been developed and empirically 
validated (Strom & Wang*, Note 8). Thin battery; which consists of six 
components, generally takes about two hours to administer. It was used 
during- regularly scheduled assessment periods to gather degree of 
implementation data for the study. A more .detailed description of the 
instrumentation and procedures fbr collecting arid analyzing degree of 
implementation data is provided in the appendix of tnis paper. 



Classroom processes . A series of observations was carried out to 
systematically obtain descriptive inform^€lon on classroom processes 
under the ALEM at the^ participating sites. The Student Behavior 
Observation Schedule (Wang, 1974b) was used to obtain inf orriiation on the 
nature' and patterns of interactions between teachers and students, the 
settings iqj which learning activities occurred, tjhe type*s of tasks on 
which students worked, and the matiner in which classroom time was spent 
by students. The Student Behavior Observation Schedule (SBOS) has been 
utilized in a number of investigati^fffSTirgk classroom pirotesses under the 
ALEM; inter-observer agreement consistently has been found to be above 
85% (Wang, 1976). ' ^ ^ 



During the first twp weeks of May, 1981, classroom' process 
information was colleQted for all first-grade and , second-grade 
classrooms in the 10 school districts included in the study (N = 72 
classrooms). Jhe decision to collect classroom process data only from 
these classes was based primarily on considerations of cost and time- 
constraints. Using the SBOS, every student in each of the 72 classrooms 
was observed for five' consecutive one-minute intervals. A total of 
1,426 students was obseirved. The total observation time included 7,130 
one-minute intervals, or approximately 120 hours of observations. The 
mean total observations per classroom was about 100 one-minute 
intervals. All of the observations were conducted by trained obslervers 
who were randomly assigned, in pairs, to the- classrooms. Each observer 
was responsible for completing the SBOS on a specific list of students^ 
within each classroom. The students were randomly assigned to the 
^observers, and they were observecl in^ the order in which their names 
appeared on the lists. For any given classroom, all bf the observations 
were made in one day. The time of day^when the observations occurred 
was not found to be significant. Average inter-observer agreement of 
95.5% was obtained in this study. 

Student learning outcomes . Two types of information on student 
learning outcomes were included in the data base for the study': 
students' progress in the ALEM" s math and readi^ig curricula, and 
standardized achievement test scores. Data on students' progress in 
math^ and reading were collected from teachers' records of the skills 
mastered by each student in each curricular area throughout the year. 
Data on students" achievement in math and reading consisted of the 
percentile scores from the standardized achievement tests routinely 
administered by the participating school districts at the end of each 
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school^^ear. It Is important to point out that because different tests 
were used by the districts included in the study, cross-district 
cotnpatisons of achievement test results could have been problematic. 
However, the achievement test scores were used in the present study to 
investigate the relationship between degree of implementation and ^ 
student achievement, and not for comparison of student achievement among ^ 
the different school districts. Therefore, it was reasoite^^that use of 
'the scores to providfe a gross indicator of student achi^ement, based on 
the natipnal norms provided by the tests ^ was justifiable, ' ^ 

, Results of , the Study , • 

Analyses of the data focuaed on addressing the followipg^ major 
questions . 

1. Could a high degree of implementation of the ALEM's 12 critical 
dimensions be attained in classroom settings across a variety 
of school sites with differing needs ' and contextual 
characteristics? 

2. When the ALEM's critical dimensions were in place, did the 
J. hypothesized patterns of classroom processes occur? To what 

extent did the classroom process patterns differ from or concur 
with the predicted trends? Were findings on the classroom 
process patterns in the ALEM classrooms compatible with 
findings in the recent research' literature on effective 
teaching? 
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5« I^id ALEM (as characterized by the decree of implementation 
1 dat4) ' and . its'' resulting classroom process patterns lead to 
^ ^ expected student achievement outcomes? 

•4.' What are^the implications of the study's findings for the 
effective ^allocation and use of school time? 

Patterns of Degree of Implementation 

The firs't step in evaluating the effects of an innovative school 
program like the ALEM is establishment of the presence or absence of the 
critical di'mensions of the program's design. The twofold purpose is to 
ensure that observed program effects can be attributed to the 
implementation of specific design features and to test the 
"generalizability'* of the program. In this context, "generalizability" 
is defined as the extent to which critical program dimensions can be 
implemented effectively in a variety of classroom settings. 

The s)pring degree , of 'implementation data for all the cl,assrooms 

included in the study were analyzed to determine (a) the extent to which 

% ■ ' ' ' "... 

-the ALEM'^8 12 critical dimensions were in place at the 10 sites; (b) 

the extent to which the distribution of classrooms with overall high, 

average, and low degrees of implementation varied among the Sites; and 

(c) the extent of the different patterns of implementation (of specific 

critical dimensions) among classrooms with overall high, average, and 

low degrees of implementation. 
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Degree of Implementation across ^ all ' sites * Tq Itivestlgate the 
extent to which the ALEM's critical dimensions were In plkce at the 10 
sites at the end of the school* yeair (1980-81), several analyses of 'the 
degree of Implementation data were performed. A summary of the mean 
degree of Implementation scores for each site across all 12 critical 
dimensions is provided in Table 3* The table showsi that, while* some 
significant, variations weire noted across dim^nsloiis, an' overall high 
degree of implementation (i.^., scores at or above 85%) was obtained; 
the overall average degree of implementation score for each- site (last 
raw of Table 3) was .85% or above. Furthermore, the cross-site "average 
scores (last column of Table 3) for all but two of tl^e critical 
dimensions were above the 85% criterion level. Xri .f act , even the mean 
scores for these two dimensions (Creating and Maintaining Instructional 
Materials and Student Planning) were liithin a • clos^ range (four 
percentage points) of the 85% criterion level. 

The overall results of the analysis sugge3t that all of the 
critical dimensions of the ALEM wfere in place in the majority of the 
participating classrooms when the degree of implementation data were 
collected in Spring, 1981. In direct contrast to findings In the 
current literature on effective scht>oling, this evidence of a high 
degree of pro^r^ implementation in a large number of classrooms 
indicated the possibility of large-scale implementation of adaptive 
education programs like the ALEM. 

Distribution of classrooms with overall high, average, and low 
degrees of implementatibn . To further 'investigate the extent to which 
the degree of implementatior^ of the ALEM was site-specific, the 
percentage's of classrooms in each site with high, average, and low 
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Mu'dfi Deyiee ul linpltiineolalioii Scofcs lor Eacli ol the ALEM'i Critical Ditnuiisiuns 



Follow Through Classroomt Mainilreaming Claisroomi 

. ■ * • A vei age 



r 

Critical 
Dimeiiiion 


Sile A 
(N » 22) 


Sii« B 

(N ' 22) 


SilaC 
(N - 17) 


Sile D 
(N - 101 


Sile E 
(N - II) 


SH«F 
(N - 20) 


SileG 
(N-4) 


Sile H 
(N - 3) 


Sile 1 
(N-6) 


Sile J 
(N -0) 


Scoi es Aci«>s\ 
All Sites 


AfiMtfvjiiHi Space 


Q7 


92 


96 


04 


98 


02 


100 


07 


01 


00 


05 


CidJimu & Main- 
l^iiufHl lnt> Mat. (.83) 


86 


BO 


74 


80 


97 


87 


71 


88 


64 


76 „ 


01 


£»uli/Coiiun> 
Rulak/Piocailuiat (.60^ 


86 


92 


90 


03 


94 


09 


97 


80 


01 


84 


01 


ManaQing Auiat (.83) 


08 


90 


100 


100 


100 


09 


100 


100 


03 


100 


00 


TaMing (.48) X 


100 


99 




100 


ibo 


> 

100 


100 


100 


100 


100 


60 


Bacoitl Ka«ptn0 1.50) 


lop 


100 


100 


06 


ioo 


96 


100 


89 


100 


ioo 


08 


Muniiofing and 
Di«i|iiating (.71) 


93 


98 


06 


.03 


03 


01 


04 


100 


88 


03 • 


04 


Piaiciibing (.87) 


09 


07 


do 


02 


100 


• 06 


100 


100 


100 


100 


08 


Tfavaling (.01) 


76 


93 


04 


95 


100 


8^ 


76 


100 


80 


04 


89^ 


Jiitliuciintl ( 74) 


92 


91 


03 


97 


02 


87 


86 


86 


76 


76 ' 


88 


Moiivaiing (.74) 


00 


92 


03 


99 


08 


88 


100 


87 


80 


06 


02 


Siudani PlanninQ (.00) 


08 


82 


, 88 


84 


86 


00 


68 


100 


60 


96 




Ovuiall Scoies 
IVi Sue 


92 


94 


02 


04 


06 


02 


90 


06 


86 


03 


02 



Nolo. *lnter-ob$erver yeneralizability coefficients are given in parentheses. 
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overall degrees of implementation were examined. High degree of 
implementation clasarooms were those identified, as scoring at or above 
the 85% criterion level in 11 or 12 of the critical dimensions; average 
degree of implementation classrooms were those with scores at or above 
85Z in six through 10 of the critical dimensions; "and low degree of 
implementation classrooms were those with scores at or above 85% in five 

4 - . - ' 

or fewer of the critical dimensions. Table 4 shows the distribution of 
each site's classrooms among the three degree of implementation levels. 

The patterns of- the distribution of classrooms among the three 
degree of implementation levels provide evidence of a range of 
site-specific characteristics* For example, in Site E, 10 (90.9Z> of 
the 11 ALEM classroom^ were at the high degree* of implementation level/ 
and none of the classrooms had an overall low degree of implementation. 
In ^ Sites G and J, on the other hand, all of the classrooms included in 
the study were at the average degree of implementation level. However, 
despite the site-specific difference^, data on the cross-site^ 
distribution of classrooms at the high, average, and low degree of 
implementation levels suggest an overall high degree of implementation 
across sites and critical dimensions. As shown in the last row of Tablis 
4, 39.9% of the classrooms were at the high degree of implementatj^ 
level. In other words, 39.9% of the classrooms scored at or above 85% 
across 11 or 12 of the critical dimensions. At the same time, 56.5% of 
the classrooms were at the average degree of implementation leveiv(i.e., 
scored at or above 85% in six through 10 of the critical dimer(8ion8) , 
and only 3.6% the classrooms were at the low degree of implementation 
level (i.e., scored at or above 85% in five or fewer of the critical 
dimensions). Furthermore, the fact that a total of 96.5% of the 
classrooms included in the study scored at either the high or average 
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Table 4 

Perctntages of Classrooms in Each Site at the H\qh, Average, 
and Low Degree of Implementation Levels 
, Spring, 1981 
(N * 138 classrooms) * 







Otgret of Implementation Levels 




Sitts 


High' 


2 

Avtrage 


3 

Low"* 


SittA 
IN - 22) 


40.9 


, 59.1 


' 0 


Sitt B 
(N-22) 


36.4 


83.6 


0 


Sitt C 
(N-17) 


3S.3 


52.9 


11.8 


SittO 
(No 19) 


52.6 


47.4 


0 


(N- 11) 


90.9 


9.1 


0 


Sitt F 
(N - 26) 


38.5 


53.8 


7.7 


SittG 
(N-4) 

Sitt H 
IN - 3) 


0 

66.7 


100.0 

r 

33.3 


0 
0 


Sitt 1 
IN -8) 


0 


80.0 


20.0 


Sitt J 
IN -9) 


0 


100.0 


0 


CrO(S-Sitt 
IN -138) 


39J 


S6.S 


3.6 



Not», 1 - Clatsrooms with icorts at or above thtB8% criterion level for 1 1 or 12 of the critical 
program dimeniions. 

2 - Classrooms with tcorts at or above the 85% criterion level for 6 • 10 of the critical 

program dimensions. 

3 - Classrooms with scores at or above the 88% criterion level for 5 or fewer critical program 

dimensions^ 



^degree of implementation levels suggests the "implementability" of the 
ALEM; £hat is » it suggests the strong possibility of effectively 
implementing the ALEM on. a large-scale basis in a variety of school 

sites . " . \ , 

-. .. ■ » 

• - ' ■ . ^ ■ 

Differences in the patterns of implementation among classrooms at 
the high, average ^and low degree of implementation levels > From both 
the program design and teacher training perspectives, it was of interest 
to investigate whether ^lassrooors categorized under the three degree of 
implementation levels showed consistent' patterns of significant 
differences . in . their implementation of the ALEM's 12 critical 
dimensions. In other words, the question was whether classrooms at the 
high, average, or low degree of implementation, levels S:ended to have 
implementation problems that ^ere similar to those in classrooms at the 
pther degree of implementation levels. A series of analyses of variance 
were perfor^d to test the extent of such patterns of differences. The 
results of the analyses are reported in Table 5* 

As V shown in Table 5, the overall degrees of implementation (mean 
scores in last row of the table) across all 12 critical dimensions were 
fouxid to differ among the three groups. In addition, significant 
differences were noted among the groups in all but three of the criti>qal 
dimensions. It should be noted that consistent patterns of 
comparatively higher mean percentage scores for the high than average 
degr(;e of implementation levels and for the average than low degree of 
implementation JLevels were found in all dimensions. 
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Table 5 

Differences in Patterns of Mean Degree of Implementation Scores Among 
Classrooms at the High, Average, and Low Degree of Implementation Levels 



# 


Mean Percentage Scores 




Critical Dimensions 


1-1 inh 


r^vci aye 


L.UW 


F-Test 


Record Keeping | 


99 


98 


87 1 

1 


2.13 


1 

Prescribing : j 


100 


96 


96 1 

1 


3.78 

■ 


Testing ] 


100 


98 


1 

95 


5.89 


i 

Managing Aides * 1 


100 


98 


1 

100 


1.83 


Arranging Space 

oi lU r awl 1 1 


98 


.93' 

> • 


77 


6.84» 


Establishing and Communicating • 
Rules and Procedures 


93 


87 


79 


7.48* 


Monitoring and Diagnosing 


95 


93 


83 


6.43 


Instructing 


96 


87 ■ 


77 


8.34 


Motivating 


99 


89 


80 


10.11 












Creating and Maintaining 
Instructional Materials 


. 92 


78 

• 


62 


9.39 ^V- 


Traveling 


100 


84 


70 


7.13* 


Student Planning 


93 


81 


74 


9.17* 


Mean Across All Dimensions 


97 


90 


81 


7.35» 



Note. V < ,01 

r " * * Dimensions for which mean scores above, the 85% crijerion level were 
' ! achieved by all three levels of degree of implementation classrooms. 

": Dimensions for which mean scores above the 05% criterion level were 

: achieved by the high and average degree of implementation classrooms, but 

not by the low degree of implementation classrooms. 
I Dimensions for which mean scores above the 85% criterion level were 

I achieved by the high degree of implementation classrooms, but not by the 

averaije and low degree of implementation classrooms. 
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Some Interesting patterns of differences in the implementation of 
particular dimensions are reflected^^ the data. The mean scores for 
all three grg^s were above the 85% criterion level lit four of the 
critical dimensions (those scores boxed in brokea lines in Table 5). 
They are Record Keeping, Prescribing, Testing, and Managing Aides, The- 
nature of these dimensions suggests that all of the tje^achers in the ALEM 
classrooms included in the study were able to achieve high performance 
in the basic mechanics of providing individualized instructfCn (i.e., 
testing, record keeping, prescribing, and making effective use of 
paraprof essionals to assist in program implementation). 

The major differences between teachers in classrooms at the average 
and high degree of Implementation levels and those in classrooms at «the 
low degree of implemeii^ation level were related to classroom instruction 
and management. This comparison is illustrated in Table 5 by the dotted 
lines ' boxing in the scores for Arranging Space and Facilities, 
Establishing and Communicating Rules and Pro(^edures, Monitoring and 
Diagnosing, Instructing, and Motivating. Finally, major differences 
between the classrooms at the high degree of implementation level and 
those at the average and low degree of implementation levels were found 
in three dimensions (scores boxed in solid lines in Table 5): Creating 
and Maintaining Instructional Materials* Traveling ^circulating among 
students to Instruct, assist, evaluate, and answer questions);, and 
Student Planning. These dimensions require skills in simultaneous 
analyses of individual students' heeds, accurate assessment of the 
nature of the tasks to be' learned, and effective identification and 
allocation of specific instructional and learning resources that can be 
used to make Instruction more adaptive to individual students^' needs. 
It is expected that application of these skills by teachers will ensure 



that appropj?dCate instructional decisions are made. 

It is noteworthy that the differences in the patterns of degree of 

implementation found in this study replicate the findings oT^l previous^ 

study (Wang, Note 9), The same hierarchy of teacher competencies 

differentiating high, average, and low implementation of adaptive 

instruction was suggested by the degree of implementation dacd from the 

- * 

earlier study, ^ 

Disgree of implementation and Classroom PrbcesjBes 

A central issue in the investigation of the ALEM' s effects w'a^ the 
extent to ^ which implementation of .the program's critical dimensions 
{resulted in classroom proceafsea identified as "desl/able" (e»g»i high 
rates of on-task behavior arfd greater frequencies or instruction-related 
than management-related interactions between teachers and students), in 
terms of both the program's goals and the findings in the, research 
literature on effect^.ve teaching (e,g, , Brophy , 1979; EU)senshine, 
1980). Results from analyses of the data from fhese two perspectives 
are discussed here. 

To investigate, the extent -to which the degree of program 
implementation was related to those classroom processes which the AL£M' s 
program features were designed' to adhleve, canonical correlation 
analyses and analyses of variance techniques were used to examine the 
classroom process and degre<f of implementation data for Spring, 1981. A 
statistically significant canonical correlation (canonical R - .36, £ < 
.01) was found, suggesting a positive relationship between ^egree of 
implementation and classroom procefces. 
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In addition; some distinct' pattertTs were noted in thq. SBOS data 
among claaarooms at Che high, average, and low^ipTeS oE itnplementation 
levels. Table 6 providea a auomary of the mean percentages of obaerved 
frequencies of the classroom process variables for the three groups of 

classrooms and the probability levels forthe obtained F's ftfom ANOVA 

( ^ 

ana;y3es. Aa noted earlier, SBOS data were collected only for the 
flrst-gra4e and second-grade classrooms in the study, (N - 72). 

Afl ahovra in T^bie 6, the differences among the three groups of 
classrooms in the frequency of inatruction-rel&ted interactions between ■ 
teachers and students were found to 'be- statistically significant. 
Furtheraore, the data also suggest a progression from classrooma at the 
low degree of Implementation level to those at the- high degree of 
implementation level, piis finding lends support to the h^othesis that 
the higher the degree of -implementation, the greater the, frequency of 
observed instructional interactions between teachers and 8tuder^t9. Also 
of interest are the findings which /suggesc that/'th^d. .interactions among 
students were signif icantj^" more disruptiv/ in classrooms at the low 
degree of implementation level-! (10% vs. 5.6Z in classrooms at the 
average degree of implementation level and .2% in classrooms at the high 
degree of implementation level) , dnd that students fn classrooms at ,tho 
high degree of implementation level spent significantly less CJnflg in 
individual settings (89.8%) than students in classrooms at the average 
(95%) and low (97%) degree of implementation levels. 

} / 

Signiiloltnt differences in the types of learning activities and the 
manner In which * learning task* were carried out by students, .al'so are 
shown ^^J^**^* ^' StuJSnts in elMsrooms at the high degree of 
implement t ion level were observed to Spend less time on 
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. • . Table 6 

Mean Percentages of Observed Frequencies of Classroom Process Variables for 
Classrooms at the High, Average^ and Low Overall Degree of Irihplementation Levels 
(in 72 first-grade and second-grade classrooms) 



Overall Implementation Levels 



High 
(N • 29) 



(N » 39) 



Low 
(N « 4) 



Variables 


Mean 


S.D. 


Mean 


S.D. 


Mean 


S.D. 


F-test 


Interactions 3«t^veen 








• 








Teachers and Students 
















Instruction 


93.3 


(.23) . 


91.7 


(.20) 


90.0 


(.17; 


4.83* . 


Management 


6.7 


(.06) 


8.3 


(.04) 


10.0 


(.34) 


?.24 K 


^Interaaions with Peers 
















Sharing Ideas 


99.8 


(.23) 


■ 94.4 


(.28) 


90.0 


(.18) 


i.02 


Disruptive / 


.2 


(.02) 


5.6 


<.03) 


10.0 


(.03) 


5.01* 


















Senings 
















Group Interactive 


. 5.1' 


' (.21) 


■ 3.0 


(.16) 


3.0 


(.18) 


2.73 


J Group Parallel 


5.1 


(.20) 


2.0 


(.'^5) 


0.0 


(0) 


6.13" 


Individual 


89.8 


(.29) 


95.0 


(.24) 


97.0 


(.18) 


4.98* 


Activity Types 
















' ; Prescriptive 


84.7 


I.3S) , 


36.0 


(.21) 


98.0 


(.16)' 


8.94* • 


Exoloratory 


15.3 


(.34) 


4.0" 


(.19) 


2.0 


(.13) 


6.37" 


Manner 
















On-Task 


v-ae.o 


(.25) 


81.0 , 


(.37) 


76.0 


(.32) 


4.92* 


Waiting " 


8.0 


(.19) 


8.0 


(.27) . 


10.0 


(.23) ' 


3.ir 


Distracted 


&.0 


(.16) 


, ■'1-0 


(.22) 


14.0 


(.25) * 


7. 49" 



Note. < .05 
••p < .01 
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teacher-assigned, prescriptive tasks (84,7%) than students in classrooms 
at the average (96%) and low (98%) degree of implementation levels. In 
addition, they were observed to spend significantly more time on 
student-selected exploratory learning tasks (15.3%), compared to 
students in classi^oms at the average (4%) and low (2%) degree *f 
implementation , levels^ .Furthermoife, * students in classrooms at the high 
degree of implementation level exhibited more .on-task behavior (86%), 
.compared' to students in classrooms at the average (81%) and low (76%) 
degree of implementation levels, and they were less distracted (6% vs. 
11% in classrooms at the average degree of implementation level ajid 14% 
in classrooms at the low degree of implementation level). It should be 
noted here that even the non-significant differences ailnong the three 
groups of classrooms reflected trends in the hypothesized ^ directions . 
For example, classro^s at higher degree of implementation levels were 



observed to have lesser frequencies of management-related interactions 
between teachers and students, g-reater frequencies of interactions among 
students for exchanging ideas, more student learning time .spent in group 
interactive settings, and les$ stjudent learning time spent waiting for 
teacher Help. - 

The overall results of the analyses of the differences in classroom 
processes among classrooms at different degree of implementation levels 

r ■ 

support the general hypothesis that there is a significant relationship 
between the extent to. which critical dimensions of th6 ALEM were in 
place and* the nature^ and patterns of the resulting classroom processes. 
Students and teachers in classrooms at the high degree of implementation 
level seemed to exhibit more of the classroom processes the^ program is 
designed to achieve (e.g., instructional interactions between teachers 
and students, constructive interactions with peers, and qn-task 
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behavior) 9 compared to students and teachers In classrooms at' the. low 
degree of implementation level* 

Student Achievement 

O- . - • • . 

The end-of-year reading and math scores from standardized 
achievement tests .administered by the school districts for the 1979-80 
and 1980-81 school years were analyzed to investigate .the overall impact 
of the ALEM oh student achievement. The results are summarized in 
Figures I, 2, and 3. (It should be noted that achievement data were 
available from four of the Follow Through sites only. These are suites 
where standardized achievement tests are given by the districts at the 
end of each school year.) ' , 

Figtire 1 presents a summary of the standardized achievement test 
scores of kindergarten through third-grade students in the four sites* 
The mean percentile scores for.eldtch grade level In 1980 and 1981 are 
shown separately* Three types of comparisons were made: a comparison 
of the Springy 1981 data with the national and estimated population 
norms; a comparison of the 1980 and 1981 scores within the same 
cohorts; and a *c&toparison of the scores for each grade level across 
^ different cohorts of students* 

As shown in Figure 1, the 1981 mean percentile scores in reading, 
and math for the first, second » and third graders consistently were 
above the national norm (50th percentile)* In all cases, for both 1980 
and 1981, Follow Through students from the ALEM classrooms also scored 
well above the estimated population norms for students from low-income 
families* (Based on a national study of the standardii^ed achievement 
test results for students from low-income families, Branden and Weis, 
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READING ACHIEVEMENT 
(Mean Percentile Scores) ' ^ 




Oatt Ttsted: Spring, 1980 Spring, 1981 
Grade: Kindergarten Grade 1 
(N - 430) (N - 363) 



Spring/1980 Spring, 1981 
Grade 1 Grade 2 
(N »626) IN -513) 



Spring, 1980 Spring, 1981 
Grade 2 Grade 3 

(N- 710) IN -474) 
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MATH ACHIEVEMENT 
IMean Percentile Scores) 




Date Tested: Spring, 1980 Spring, 1981 
Grade: Kindergarten Gradal 
(N-430) (N-363) 



Spring, 1980 Spring, 1981 
Grade 1 Grade 2 
IN -626) (N-513) 



Spring, 1980 Spring, 1981 
Grade 2 Grade 3 
IN- 710) IN- 474). 



Figure 1. Mean Percentile scores from the end-of-year standardized achievement tests-cohort 
comparison. 

Note . The solid line represents the expected percentage based on the national norm. 

The dotted.line represents the expected percentage based on the estimated population 
norm for children with similar SEE backgrounds. 
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Note 10» have estlmatecf that the expected average performance of 
students like thoise In the National Follow Through Program Is at the 
20th percentile in reading and the 13th percentile in math) . The 
average reading achievement score for first-grade Follow Through 
students from the ALEM classrooms in 1981 was at the 58th percentile. 
In math, thi first-grade students' mean percentile score was at the 66th 
percentile. In Spring, 1981 » the average reading achievement score for 
second graders was at the 55th percentile; the average math achievement 
sco'te, at the 53rd percentile.; Third graders' average achievement score 
in reading for 1981 was at the 53rd. percentile; their average math 
achievement score was at the 51st percentile. 

It has been hypothesized that steady improvement in student 
achievement can be expected as students spend 'more time under the ALEM 
and' program Implementation Improves. When the Spring', 1981 achievement 
test scores, for each grade level were compared with the scores from the 
previous , year for Che same groups of students, improvements in student 
achievement were evident. Students in the first, second, and third 
grades showed an increase in their meah percentile ranks in reading. 
For example, first-grade students in 1981 scored higher in reading X58th 
percentile) than they did as kindergarteners in 1980 (49th percentile). 
Second-grade students in 1981 scored, on the average, at the 55th 
percentile in reading, whereas in 1980 the same students scored' at the 
48th percentile. Similarly, third graders in 1981 scored higher in 
reading' (53rd percentile) than they did as second graders in 1980 (46th 
percentile) . 



To examine the specific effects of improved program implementation 
on student achievement from Spring, 1980 to Spring, 1981, t:he 1980 and 
1981 achievement scores from the spring testing for each grade level 
were compared (Wang, Note 9). As shown in Figure 1, the 1981 scores 
seemed to be consistently higher than the 1980 acores. For example, the 

first graders' 1981 mean percentile score in reading was at the 58th 

.J ■ ■ 

percentil[e, whereas the mean score for first graders in 1980 was at thq 

48th perceatile. - In math, the ' first graders scored at the 66th 

percentile in 1981, an increase over the 1980 percentile rank of 58* 

Differences in the kindergarten, second-grade, and third-^grade! reading 

ani math scores between 1980 and 1981 were equally noteworthy. 

An alternative way of analyzing the ALEM's impact on student 
achievement is to compare the distribution of achievement scores within 
the top and bottom quartiles with the national norms published by the 
specific standardized tests. Figure 2 showd the percentages of students 
from the fou^* sites who scored above the 75th percentile in 19i80 atid 
1981. The solid line indicates that, based on the national norms for 
both reading and math, 25% of the students were expected to score above 
the 75th percentile. As shown in Figure 2, the achievement results from 
Spring, 1981 indicate that^ more students scored in the upper quartile in 
reading and math than expected, based on the national norm. For 
example, in 1981, 32% of the first graders scored in the upper quartile^ 
in reading, and 46% scored in the upper quartile in math. Examining 
cohorts, the number of first-, second-, and third-grade students laho 
dcored in, the upper quartile in reading in 1981 increased significantly 
over 1980. Thirty-five percent of the second graders scored in the 
upper quartile in 1981 » compared to only 20% of the same students in 
1980. In math, a significant increase was seen for the first graders in 
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READING ACHIEVEMENT 



32% 



35% 




Dat«Tfi;ttd: Spring, 1,980 Spring, 1981 
Gradt: Kindtrgarttn Gradt 1 
(N-S6) (N-116) 



Spring, 1980 Spring, 1981 Spring, 1980 Spring, 1981 
Gridt 1 Gradt 2 Gradt 2 Gradt 3 

(N-125) (N-180). (N- 156) (N- 128) 



MATH ACHIEVEMENT 




Data Ttsttd: Spring, 1980 Spring. 1981 
Gradt: Kindtrgartan Grada 1 
(N-66) (N^167) 



Spring, 1980 Spring, 1981 
Grada 1 Gradt 2 

(N-194) (N-1S9) 



Spring, 1880 Spring. 1981 
Grada 2 Grada 3 
(N-220) (N-137) 



Figura 2. Parcantagat of studants who scortd abovt tht 75th perctntilt bactd on tha end-of-yai 
sundardizad achiavamant tait rtsults. 

Now. Tht solid lint indicatn 2B% of tht itudtnw would bt txptettd to tcort at or abovt 
tht 75th ptrctntilt. baud on tht national norm. 
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1981, vrlth 46Z scoring in the upper quartile. On the other hand, the 
percentage of second graders in the upper quartile in math stayed the 
same in 1981, and the percentage of third graders in the upper quartile 
in math dropped slightly from 31% to 29%, Improvements across grade 
levels also are evident. For exaul^le, 20% of the first graders in 1980 
scored in the upper quartile in reading. This increased to 32% in 1981. 
In math, 31% of the first graders scored in the upper quartile in 1980; 
,46%* scored in the upper quartile in 1981. 

{ 

Figure 3 summarizes the data on the p^^^ta^es of studj^nts who 
scored in the lower quartile, bas^d on the achievement tests' published 
norms. The solid lines indicate that 25% of the students were expected, 
to score below the 25th'percentile, according to the test norms. As 
shown in Figure 3, in both reading and math, . and across all grade 
levels, there were substantially fewer students in the lowejj^ quartile 
than the national norm. Furthermore, when .cohort comparisons of the 
1980 and 4981 achievement scores were made, the data suggest a trend of 
decreasing percentages of students in the lower quartile. For. example, 
a reduction was found for all grAde levels in the percentages of 
students in the lower quartile in reading. In 1981, only 15% of ' the 
second graders scored in the lower quartile, compared to 23% of the same 
group of students in 1980. In math, the percentages of kindergarten, 
first-grade I, and second*^grade students scoring in the lower quartile 
decreased in 1981. It is also significant that across all grade levels 
in reading and math, the percentages of students scoring in the lower 
quartile decreased between Spring, 1980 and Spring, 1981. 
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READING ACHIEVEMENT 



29% 



23% 



27% 



14% 




15% 




Dm Tcstid: Spring. 1060 Spring. 1981 
Grtdt: Kintfargantn Gridt 1 

(N - 125) (N -51) 
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70- 
60. 




I 60- 
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Spring, 1980 Spring, 1981. Spring, 1980 Spring. 1981 
Gradfl 1 Gradt 2 Gradt 2 Gr«da 3 

(N • 144) (N - 1 18) (N - 192) (M • 104) 

MATH AqniEVEMENT 



_ 23% 




Ottt Ttstcd: Spring, 1980 Spring, 1981 
Grada: Kindargarran Grada 1 
(N - 107) (N - 38) 



Spring, 1880 Spring, 1981 Spring, 1980 Spring, 1981 
Grada 1 Grada 2 Grada 2 Grada 3 

(N - 138) (N - 97) (N - 149) (N - 109) 



' Figura 3. Parcantagas of itjiidann who icorad balow tha 2Sth parcantila basad on thvand-of-yaar 
standardlzad achiavamant tast rasults. 

0 

Nott. Tha lolid Una Indicnas 25% of tha nudantt would ba axpactad to scora at or balow 
th« 25th parcantila, baaad on tha national norm. 
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In the investigation of the extent to which degree of 
implementation was related to student achievement , two specific 
questions were addressed: **Ta% what extent were the degree of 
implementation measures related to students' learning progress in the 
ALEM^'s math and\ reading curricula (i.e., the number of curricular 
objectives mastered"?; and, "To what extent did the nature and patterns 
of student achievement differ among classrooms at different degree of 
' implementation levels"? 

To provide the data base for answering the first question, 
canonical correlations between degree of implementation scores and 
students' progress in the ALEM's reading and math curricula, and between 
degree of implementation scores and students'; end-of-year achievement 
scores, were performed. Results from Ihe' analyses suggest that the 

degree of program implementation was significantly related to both the 

* 

number of math and reading objectives mastered by the students across 
all the classrooms included in the study and the students' end-of*year 
achievement scores in these two basic skills subject areas (canonical R- 
.5998, p < .01). 

\ 

Table 7 provides a summary of the results of the analysis of the 
differences in student achievement among classrooms at the high, 
average, and low degree of implementation levels. Ad shown in the 
table, a consistent pattern of higher degrees of implementation and 
greater student achievement is suggested, although th^ differences in 
student achievement among the three groups of Qlass rooms were not 
statistically significant. There are at leaqit two plausible 
explanations 'for the positive, yet non-significant, trend indicated by 
these results. First, the mismatch between the ALEM's curriculum and 
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Table 7 

Summary of Student Achievement Outcomes for Classrooms at the High, Average, 
and Low Overall Degree of Implementation Levels 



Degree of Implementation Leveis 



HIgJV 
(N -S5) 



Average 
(N - 78) 



Low 
(N - S) 



Vanablts 



Mean 



S.D. 



Mean S.O. 



Mean S.D. 



F-test' 



Student Learning Progrws 
(Mean Objectives Mastirad) 

Math pbjeaivea 
Reading Objectives 



29.77 (17.4) 
33.49 (20.3) 



28.97 (17.8) 
28.52 (19.4) 



20.21 (1S.8) 
27.01 (20.1) 



2.87 
1.13 



Standardized Achievement Scores 
(Pereantile Ranic) 

Math 53.49 



Reading 



53.69 



(23.5) 
(22.5) 



52.16 (23.9) 
52.57 (21.9) 



48.00 (19.9) 
51.02 (19.4) 



2.10 
1.92 



Note. *None of the F-ratios is significant at or beyond the .05 level. 
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the test content, as well as the latitude provided under the ALEM for 
teachers and students to choose the amount and variety of task 
assignments (thereby directly affecting the number of currlcular 
objectives mastered), both are likely to attenuate the 
Implementation-outcome association. The second plausible eixplanatlon 
for the rpn-signlf leant results has to do with the small variance In the 
degree Implementation among the different groups of classrooms that/ 

were com|)ared. Due largely to Intensive teacher-training efforts, the 
ertd-of^jrear mean degree of implementation scores across all thfe 
classrQoms, Including the scores for those classrooms at the low degree, 
of Implementation level, were quite high. For example, the overall 
score for classrooms at the low degree of implementation level was 81Z* 
Although relatively uniform implementation is desirable from an 
educational standpoint, it diminishes the apparent 

impleAentation-outcome association, since there are few low degree of 
Implementation classrooms to establish the trend. 

Allocation and Use of School Time 

The study's findings reported thus far suggest the relationship 
between the ALEM' 8 design features (degree of implementation) and 
classrooni processes and student learning outcomes. To examine further 
the implications of the program's design for the effective allocation 
and use of school time by teachers and studentsT^^aJWdtional analyses 
were conducted. The focus was on investigating the hypothesized 
relationship between the degree of implementation and the manner in 
which students in the study spent their learning time, as well as the 
relationship betweciT the manner In which students spent their learning 
time and other classroom process variables* 

46 



Relationship between degree j)f Implementation and the manner In 
',f . ■ / ^ • ■' ■ 

wiilch students spent their learning time . To Investigate the extent to 

'which the 12 critical dimensions of the ALEM were relate^ to the manner 

In which student learning tlnjie was spent, correlation analyses between 

the mean degree of Implementation score for each of the critical 

dimensions and the three classroom process variables related to the 

manner in which learning time Is spent (l.e.y on-task, distracted, and 

waiting) were performed. The results of the analyses are summarized' In 

Table 8* Although the correlations were greatly attenuated by the 

uniformly high .degtee of on-task behavior (see Table 6) and, probably, 

by the amall sample of behavior observed for each student * (five 

ft 

consecutive 1-mlnute Intervals for each of the 1,426 Students), more 
than half the correlations were significant. 

The overall correlation patterns shown In tl>e table suggest that 
the extent to which the vari,ous. critical dimensions were In place was 
positively related to students' on-task behavior and negatively related 
to their distracted behavior. Little relationship Is suggested between 
the degree of Implementation scores and student waiting time. 

The patterns of relationship between each of the 12 critical 
dimensions and the "manner" variables are noteworthy. In general, they 
seem to be consistent with the predlctM patterns. This consistency Is 
Illustrated by the fact that two of the critical dimensions under the 
ALEM's structural domain — Arranging Space and Facilities and 
Establishing and Communicating Rules and Procedures — correlated 
significantly with students' on-task behavior. In addition, on-task 
behavior w«« found to be significantly associated with 
instruction-related function* »uch as Monitoring and Diagnosing, 
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Table 8 

Corrtlations Bttwetn Variables Related to.the Manner in Which Student. Learning 
Time Was Spent and the Degree of Implementation of the ALEM'j Critical Dimensions 

(N • 72 classrooms) 



Manner in Which Time Was Spent 



Critical, Dimensions 


On-Task 




Oistriaad 


• Waiting 


Arranging Space and Facilities 


.20' 




-.18 


.17 


Creating and Maintaining 
Instruaional Materials 


-.19 




.18 


.17 . 


Establishing and Communicating 
Rules and Procedures 


.22* 






-.08 


Managing Aides 


.22* 




-.20* 


.20* 


Testing 


-.23* • 




.20* T 


.19 


Record Keeping 


-.23* • 




.19* 


.19 


Monitoring and Diagnosing 


.22* 




.18 




Prescribing 


, .23* • 

t 




-.21* 


.18 


Traveling ♦ 






-.20* 


.18 


instruaing 


.20* 




-.17 


.17 ' 


Motivating 


■21 • 




-.06 


.19 


Student Planning 


^ -.22* 




.20* 


.18 


Total Mean Degree 
of Impttmtntation 


.40 


— * 


•31 


-2i 



Nota. * Corralations significant at or baypnd tha . 1 0 lavall 
** Corralations significant at or btyond tha .05 iaval. 
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Prescribing, Instructing, * and Motivating, It is also noteworthy that 
distracted behavior was found to be negatively cdrrelated with 
instruction-related dimensions, such as Prescribing, Traveling, 
Instructing, and Motivating, 

' \ ' ' ■ ■ . • •. ■ ■ • ' ■ ... 

In general, results from the , correl^ion analyses ' suggest that 

implementation '^contexts" (i,e, , the extent to which the ALEM's critical 

design features were in place) affected the manner" .^n which students 

spent their learning time in school. Furthermore, this relationship waa 

it| keeping with the hypothesized relationship between the manner" in 

which school time *is spent by s^iudents and the Implementation of 

specific program features. Of particular significance is the finding 

that teacher expertise in instruction-related functions involving active 

interactions witlv students tended to be positively associated with 

■ -, •■■[ ' . ' * 

students/ op-task behavior and negatively associated witli 'their 

distracted behavior. It should be pointed ' out that, although this 

finding of a relationship between teachers' instruction-related behavlo^ 

and students' time-on-task is quite consistent with recent reports in 

the effective teaching, research (e,g,, Brophy, 1979; National School 

Putilic Relations Association, 1981), the similar patterns of correlation 

' • • . * . ' . , ■ 

were observed in two quite different types of classroom learning 

environments. The instruction-related teacher functions associated with 

on-task behavior under the ALEM were carried out in open and relatively 

informal 'environments where small-group and ^individualized instruction 

were the predominant instructional modes. On the other hand, data from 

the effective-teaching research primarily are from classrooms where 

conventional group-based instruction prevailed (e.g.. Good & Grouws, 

1979; Rosenshine\ 1980). 



Relationship^ between the caanner in which learning time was spent, 
and other ciassroom process variables * To examine the extent to which 
other classroom process variables (e«g«, the nature and purpose of 
teacher-student Interactions, the types of tasks on which students 
worked, and the settings In which students worked) were highly related 
to the manner In which ' students In the study spent their learning time, 
correlation analyses between the ' relevant classroom process data from 
the study and the three "manner" variables were performed. The results 
are reported In Table 9. (It Is noted here that, as with the 
correlation patterns between degree of Implemeutatlon and the manner In 
which students spent their learning time ^ the relatively small 
/ttfagnltudes of the significant correlations shown In Table 9 are the 
likely result of the small variance In the measures used In the 
analyses .) 

Of particular Interest In this series of analyses was the extent to 
which the ALEM^s predicted classroom processes led to more effective use 
of student learning time. From the program design perspective, among 
the more Interesting findings are those which suggest that 
student-Initiated interactions were associated positively, with 
distracted behavior and negatively with waiting behavloTr, while 
teacher-lnltlated Interactions were related positively to on-task 
behavior^ and negatively to distracted behavior. Furthermore, 
instruction-related Interactions between' teachers and students 
correlated positively with on-task behavior and negat,|A^y with* both 
waiting and management-related Interactions between teachers and 
students. In addition, disruptive interactions among peers w^te 
associated with waiting. | 



Table 9 

Significant Correlations Between Variables Related to the Manner in Which Student Learning 
Time Was Spent and Other Classroom Process Viariables 
. (N • 1426 students) 



Manner in Which Time Was Spent 



Classroom Process Variables 



On-Task 



Distracted 



Waiting 




Interactions Between Teachers and Students 
Studentrinitiated Interafctions 
' Teacher-initiated Interactions 
IpstructiQpal Interactions with 

Teachers 
Management Interactions with 

Teachers 
Sharing Ideas with Students 
Disruptive Interactions 



Activity Types 



Prescriptive 
Exploratory 



-.01 
.08* 

.06* 

.OX 
.01 
-.23* 



.08' 
.13' 



.08* 
-.07* 

-.02 

.07 • 

-.03 
.03 



.12* 
.12* 



-•08* 

-.03 

-.11* 

-.07* 
.02 
.27' 



.01 
.06" 



Settings 



Group Interactive 
Group Parallel 
Individual 



.09' 

.04 

.10* 



•.10* 

.03 

.10* 



-.04 
-.02 
.01 



Task Initiation 
StIMnitiated 
Assigned 



.07' 
-.06' 



.01 
.02 



.01 
.01 



Note. * Correlations significiant at or beyond the .01 level. 
** Correlations significant at or beyond the .05 level. 
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In general, the results of these analyses reflect patterns 
consistent with those classroom process outcomes the AL£M is designed to 
achieve. These outcomes, in turn, seem to be associated, as predicted, 
with the manner in whiich students spent their learning time* For 
example, one of the unique design features o^^^the ALEM is its 
instructional-learning management system, which is designed specifically 
to help students assume increased responsibility for managing their own 
learning and behaviors, thereby enabling teachers to devote more time to 
instruction and less time to routine classroom management. The 
contentions are that as students become more proficient in managing 
their learning behavior, they show a concomitant increase in the amount 
of time spent on-task, and that as students spend more time on- task, 
teachers are able to spend more time instructing. The correlation 
patterns reported in Table 8 seem to provide evidence in support of 
these contentions. 

Comparability of the Findings with Recent Research 

There are som^ Interesting areas of agreement and contrast ' between 
the findings reported in this paper and those from the extant research 
literature on effective teaching. Perhaps the most controversial one i^ 
the challenge posed to. the predominant data base on the efficacy of 
educational practices that attempt to accommodate the learning needs of 
individual students /and the educational benefits of students' active 
role in the planning and management of their learning and ^behaviors. 
There is little evidence in the literature to support either the 
efficacy of the adaptive instruction approach or the practicability of 

implementing adaptiv^ instruction programs ,in sfi4idol settings. 
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Among tfie most frequent criticisms of adaptive instruction programs 
is that they result in ineffective utilization of teacher and student 
time as well as lower student achievement. It is argued by many that a 
major design flaw of such programs is the expectation that' students work' 
alone most of the time and, as a result, they tend to have fewer 
instruction-related interactions with teachers, lower rates of 
time-oa-task, and lower rates .of achievement than students in classroomSs 
where more traditional programs are implemented. In this context, the 
present study's findings related to time-on**task and student achievement 
are of particular interest.. 

Findings from the present study also challenge current opinion on 
the "implementability" of adaptive instruction programs (i.e., the 
potential for widespread implementation of programs like the ALEM in 
school settings). The general consensus is that effe^ctive 
implementation of adaptive instruction requires considerable teacher" 
expertise and resources. Many have come to the conclusion that even if 
adequate school organizational and resource supports could be provided, 
the knowledge base on how to develop the teacl|pr expertise required to 
effectively imi>lement' the addptive instruction approach is sorely 
lacking. Based on the. assumption that it is extremely difficult to 
^'reproduce*' the special ^ort^f teachers required by such programs, 
findings of successful demonstrations of adaptive instruction have been 
attributed to unusual teachers and/or students. However, in the ALEM 
classrooms where the present study was conducted, most of the teachers 
(more than 95Z) were able to develop the expertise, or use the expertise 
they already possessed, to effectively provide adaptive instruction* 
These results clearly point to the feiasibility and possibility that, 
with adequate training support, a large percentage of public school 




teachers can provide the kind of adaptive instruction that generally is 
believed t^ be a rare occurrence. (It is noteworthy that .results from a 
study condutsJ:.ad^oncurrently show significant improvements in program 
implementation fr&m fall to spring as the result of the utilization of a 
data-basedy individualized staff development program [Gennari, Tomlch, & 
Zajac , Note 11 ] ) . 

* 

Summary and Conclusion 

The overall results from the study suggest . two maj^or findings. 
First, as V critical features of the ALEM were established, so were 
classroom processes that are hypothesized to be facilitative in 
increasing the allocation and use of school time for student learning 
and teacher instruction. Classrooms at the high, average, and low 
degree of implementation levels, were characterized by differences in 
classroom processes, particularly the manner in which students spent 
their school time and the nature and patterns of instructional 
interactions between teachers and students. Second, data from the study 
show that it was possible to establish and maintain implementation of 
the ALEM in a variety of school setc;ings. AB noted above, this finding 
is especially interesting in light of the research literature which 
suggests the difficulty, if not the impossibility, of wide-;;^cale 
implementation of educational innovations (like the ALEM) that use an 
adaptive instruction approach to help students attain high levels of 
achievemerit in the basic skills, self-direction, independence, and 
soqial cooperation. Not only do the study's X^^ults support the 
practicability of implementing such innovative programs, but they also 
s^gge^t a composite scenario of classroom environmetits that differ 
significantly from traditional classroomd. 
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The data frotQ the 156 classrooms suggest that fundamental changes 
cati occur in the design and delivery of adaptive instruction programs in 
a large number of classrooms » under the condition that program ^ 
implementation closely apprqxima^es critical design features. The 
findings show that teachers were able to establish and maintain 
classropm learning environments where the emphasis is on development of 
self-reliance and perceptions of social and cognitive, competence, as 
well as mastery of academic skills. Furthermore , there is evidence that 
desirable classroom processes (e«g,, time-on-task and instructional 
interactions with teachers) identified in the research on effective 
teaching , can indeed be attained under adaptive instruction programs like 
the ALEM, 

Despite the limitations of attempting to generalize the 
implications of findings from a study of a single program, support is 
provided for the contention that it is unnecessary to trade off 
achievement in basic skills . for student growth in dimensions such as 
independence,*'^ self-responsibility , and social cooperation. Attainment 
of both sets of educational skills is shown to be possible through the 
creation of learning environments where relatively structured 
teacher-directed experiences can be integrated in students' schooling 
process with more open-ended, student-initiated learning experiences. 
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and Analyzing Degree of /linplem,entation Data 
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A systematic s$t of instruments^ and procedures has been developed 

to r^bllect and " analyze data on tfhe degree^ of implementation of the 

^ ^ / . . - ' ^ ■ ' - ^ ' ' :- 

Adaptive Learning Environments Model CALEM) in school settings. 

• V ' - , . ■ ■•' ' ' . . . ' 

■•,.„•-- ■ •* ' , 

Included are the ImplementatALon Assessment Battery for Adaptive' 



Instlruction and a computei^ program for analyzing .aati^:><^^^]^yiag the da^a 



' ^ collected through the battery 



Implementation a^essment Battery . / . * 

for ^^ptive Instruction ' 

Development of th^ battery of degree' of implementatfion Instrumeitts * 
was bdsed on, the 12 critical dimensions (features) identified through 
analysis of the^ ALEM' s sl:ructural and action domains. The 12 critical 

dimensions are Arranging Space and Facilities (AS&F); Creating and 

. ^<>S . ^ ' ■ . • . ' . 

Maintajtning , Inst rue tiotval Materials (CMIM) ; Establishing and 

Commuhicating Rules and Procedures. (ECRP); Managing; Aides (MA); 

Testing (TEST); Record Keeping- (RCRD); Monitoring and Diagnosing ^ 

^|m&D); Pr^escribing (PRES); Traveling (TRAvV;" Instructing (INST); 

Motivating (MOTI); and Student Planning (SP). The critical dimensions 

incorporate 96 pe^fo^rmance indicators for assessing the presence or 

absence of the critical dimensions li;! ALEM classrjooms. The performance 

indicators, in turn, are grouped into the six instruments that comprise 

the Implementation Assessment ^Battery for Adaptive Iristruction (Wang, 

Note' 7)% - 
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• Two of the Instruments are used In observing dynamic aspects of 
program Implementatlbn— the Observation Checklist for Teacher Traveling 
Behavior and the Observation. Ch'ecldlst for Student Classroom Behavior, 
Both are admlnlsteted during class time. Two instrument's — the Checklist 
for Physical Design of^the Classroom and ^the Checklist for Classroom 
Records — -focus -qn non-dynamic observables and^' ai:e administered when 
students and teachers are not present in the classroom. The final two 
Instruments — the Student. laterview and the Teacher Interview—are 
interview questid^nnaites designed to elicit comments from students and^ 
teachers on various aspects^ of program implementation. The Teacher 
Interview is administered before or after class time;-* the Student 

Interview, dufidg class time. 

• ■ ■ • * ■ ■ , ; . 

The battery is used by school personnel on a regular basis to 
collect infomiation- for staff development purposes (i.e., the design of 
in-service training) and to monitor overall degree of implementation 
of the" ALEM in their classrooms. Degree of implementation > data also are 
collec^d three times during the school year (usually in Octobep, 
February, and April) specifically for^.^program evaluation purposes. It 
generally takes about two hours per classroom to administer the entire- 
battery. 

Analysis and Reporting of the 

Degree of Implement a t ion. Data 

. ' . ■ \ « _ 

. ' • .1 - 

. A computer pfrogram has been developed to analyze and report degree 
of implementation data in a fotpi that can be used by site personnel to 
design a^d monitor site-specific ataff development plans for Improylng 
program Implementation (Schmldhammer , Note 12). Figure A-l Illustrates 
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CRITICAL PROGRAM DIMENSION COOES 

AS&F ' ARRANGING SPACE & FACILITIES M&O MONITORING & OlAGIStOSING 

.CMIM CREATINQ & MAINTAINING INSTRUCTIONAL MATERIALS PRES PRESCRIBING 

ECRP ESTABLISHING & COMMUNICATING RULES & PROCEDURES TRAV TRAVEL-1NG 

MA MANAGING AIDES INST INSTRUCTING 

' TEST TESTING MDTI MOTIVATING 

RCRO RECORDKEEPING SP STUDENT PLAtlNING 

NUMBERS^ IN PARENtHESES INDICATE NUMBERS OF ITEMS (PERFORMANCE INDICaVdrSI 

INCLUDED IN THE.OEGREE OF IMPU^A^NJATION ASSESSMENT INSTRUMENTS . " ■ 

DISTRICT X 

" -^^PRO., 1981 

AS&f'^ CMIM ECRP MA ^ TEST ^CHO ' M&O PRES TRAV INST MOTI SP 

nn hi) (27) (3) 14) (3) (8) (S) . (2) (H) (S) (3) 
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Figure A-1 A sample computer printout of a summary of degree of implementation tJata. 



the format for reporting the data. As shown In the figure , which 
simulates a computer printout of the results of the analysis of the 
April degree of implementation data from School District }C» the data are 
analyzed in three different levels^ or units: school, grade level, and 
class (teacher). The mean scores for the critical dimensions of the 
ALEM are reported' in 12 separate columns . the names and acronyms for 
the dimensions are listed at the top of the printout. The number in 
parentheses under the acronym for each. dimension indicates the ^total 
number of performance indicators included in the six degree of 
Implementation instruments for that dimension. For example, und.er CMIM 
(Creating and Maintaining Instructional Materials), shown in the second 
col^mm of Figure A-1 , 11 performance indicators are included in the 
instruments to assess the implementation of that aspect of the AL£M's 
design. The printout also includes Information on edch teacher's degree 
of implementation of the 12 critical dimensions, as well als mean 
percentages of the degree of implementation for each grade within a 
particular school, for a given school, and for specific grade levels 
across an entire school district. 

The kind of summary analysis shown in Figure A-1 is used by school 
personnel to determine areas where improvements in program 
implementation or program refinement are needed. Analysis of changes in 
degree of implementation from one assessment period to the next, for 
example, provides information to teachers about their implementation 
progress, as well as the data base for designing and evaluating the 
effectiveness of schools' staff development efforts in improving and 
maintaining ^^^^ degree of program implementation. In addition, the 
overall degree of implementation across a variety of schools for an 
extended period of time provides evidence of the program's 



**laiplementablllty That ls» the proportion of classrooms at an overall 
high degree of Implementation level acrods a variety of schools and over 
a reasonable period of time serves as an Index for assessing the extent 
to which program Implementation can be established and, maintained 
consistently by teachers with different characteristics, on a wide-scale 
basis, and in different school settings (Wang, Note 13). 
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